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FOREWORD 


SWOE  Report  94-2,  January  1994,  was  prepared  by  S.  Rivera,  Jr.  of  U.S.  Army 
Engineer  Waterways  Experiment  Station,  Vicksburg,  Mississippi. 

This  report  is  a  contribution  to  the  Smart  Weapons  Operability  Enhancement 
(SWOE)  Program.  SWOE  is  a  coordinated.  Army,  Navy,  Marine  Corps,  Air  Force  and 
ARPA  program  initiated  to  enhance  performance  of  future  smart  weapon  systems  through 
an  integrated  process  of  appl)nng  knowledge  of  the  broadest  possible  range  of  battlefield 
conditions. 

Performance  of  smart  weapons  can  vary  widely,  depending  on  the  environment  in 
which  the  systems  operate.  Temporal  and  spatial  dynamics  significantly  impact  weapon 
performance.  Testing  of  developmental  weapon  systems  has  been  limited  to  a  few  selected 
combinations  of  targets  and  environmental  conditions,  primarily  because  of  the  high  costs 
of  full-scale  field  tests  and  limited  access  to  the  areas  or  events  for  which  performance  data 
are  required. 

Performance  predictions  are  needed  for  a  broad  range  of  battlefield  environmental 
conditions  and  targets.  Meeting  this  need  takes  advantage  of  significant  DoD  investments 
by  Army,  Navy,  Marine  Corps  and  Air  Force  in  1)  basic  and  applied  environmental 
research,  data  collection,  analysis,  modeling  and  rendering  capabilities,  2)  extensive  target 
measurement  capabilities  and  geometry  models,  and  3)  currently  available  computational 
capabilities.  The  SWOE  program  takes  advantage  of  these  DoD  investments  to  produce  an 
integrated  process,  the  SWOE  Process. 

SWOE  is  developing,  validating,  and  demonstrating  the  capability  of  the  SWOE 
Process  to  handle  complex  target  and  environment  interactions  for  a  broad  range  of 
battlefield  conditions.  SWOE  is  providing  the  DoD  smart  weapons  and  autonomous  target 
recognition  (ATR)  communities  with  a  validated  capability  to  integrate  measurements, 
information  bases,  modeling,  and  simulation  techniques  for  complex  environments.  This  is 
a  DoD-wide  partnership  that  works  in  concert  with  advanced  weapon  system  developers 
and  major  weapon  system  test  and  evaluation  programs. 

The  SWOE  program  started  in  FY89  imder  Balanced  Technology  Initiative  (BTI) 
sponsorship.  Present  sponsorship  is  by  the  U.S.  Army  Corps  of  Engineers  (lead  service), 
the  individual  services,  and  the  Joint  Test  and  Evaluation  (JT&E)  program  of  the  Office  of 
the  Director  of  Test  &  Evaluation,  Office  of  the  Under  Secretary  of  Defense 
OUSD(A/DT&E). 

The  Joint  Test  Director  is  Dr.  J.P.  Welsh.  The  Deputy  Test  Directors  are:  (Army) 
LTC  Jerre  Wilson  and  (Air  Force)  Maj  Richard  Jennings.  The  Integration  Manager  is  Mr. 
Richard  Palmer.  The  Modeling  Configuration  Manager  is  Dr.  George  G.  Koenig. 
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Preface 


The  analysis  activities  reported  herein  were  conducted  by  the  U.S. 
Army  Engineer  Waterways  Experiment  Station  (WES)  is  support  of  the 
Smart  Weapons  Operability  Enhancement  (SWOE)  Joint  Test  and  Evalua¬ 
tion  (JT&E)  Grayling  1  exercise  conducted  at  Grayling,  MI,  from  15  Sep¬ 
tember  to  25  October  1992.  This  effort  was  funded  by  the  Department  of 
Defense  SWOE  JT&E  Program  Office,  Hanover,  NH.  Dr.  J.  Pat  Welsh 
was  the  Joint  Test  Director.  ETC  Jerre  W.  Wilson  was  Army  Deputy 
Director,  SWOE  JT&E. 

WES  has  prepared  three  related  reports  in  support  of  the  Grayling  1  ex¬ 
ercise  for  the  SWOE  JT&E  Program.  These  are  as  follows: 

a.  “Grayling  1  Information  Base  for  Generation  of  Synthetic  Thermal 
Scenes” 

b.  “Grayling  1  Site  Characterization  and  Data  Summary” 

c.  “Analysis  of  Thermal  Imagery  Collected  at  Grayling  1,  Grayling, 
Michigan” 

This  study  was  conducted  under  the  general  supervision  of  Dr.  John 
Harrison,  Director,  Environmental  Laboratory  (EL),  WES,  and  Mr.  H. 
Roger  Hamilton,  Acting  Chief,  Natural  Resources  Division  (NRD),  EL, 
and  Mr.  Harold  W.  West,  Chief,  Environmental  Characterization  Branch 
(ECB),  NRD,  and  under  the  direct  supervision  of  Mr.  Charles  D.  Hahn, 
WES  project  coordinator. 

Mr.  Salvador  Rivera,  Jr.,  ECB,  prepared  this  report.  Field  support  was 
provided  by  Messrs.  Hahn,  Thomas  Berry,  Marvin  J.  Wooley,  David 
Leese,  Clarence  Currie,  Alfonzo  Vasquez,  Jerrell  R.  Ballard,  and  Stephen 
Pranger.  Mr.  Bruce  Sabol,  ECB,  assisted  in  the  image  analysis 

At  the  time  of  publication  of  this  report.  Director  of  WES  was  Dr.  Rob¬ 
ert  W.  Whalin.  Commander  was  COL  Bruce  K.  Howard,  EN. 


1  Introduction 


The  Smart  Weapons  Operability  Enhancement  (SWOE)  Joint  Test  and 
Evaluation  (JT&E)  Program  is  a  Department  of  Defense  (DOD)  coordinated 
multiservice  effort  to  address  problems  related  to  smart  weapon  system  de¬ 
velopment,  test,  and  evaluation  (DT&E)  in  the  worldwide  range  of  battle¬ 
field  environment  conditions.  The  thrust  of  the  Grayling  1  field  exercise 
was  to  collect  environmental  data  necessary  to  generate  various  synthetic 
thermal  scenes  and  to  collect  thermal  infrared  (IR)  image  data  for  use  in 
the  validation  of  the  SWOE  thermal  scene  generation  procedure. 


Background 

Future  smart  weapons  systems  will  be  forced  to  become  more  “autono¬ 
mous”  because  of  the  ever-shrinking  manpower  available  on  the  modem 
battlefield.  The  typical  approach  to  developing  smart  weapons  has  been 
the  test-fix-test  methodology  for  the  test  and  evaluation  phases  of  develop¬ 
ment.  Tests  or  technology  demonstrations  are  scheduled,  and  the  proposed 
system  is  thoroughly  tested  under  various  environmental  conditions.  The  . 
results,  however,  may  not  be  similar  if  the  environmental  conditions  are 
changed.  Also,  the  cost  of  this  type  of  testing  is  extremely  high.  The  pri¬ 
mary  thmst  of  the  SWOE  JT&E  Program  is  to  produce  a  validated  proce¬ 
dure  for  generation  of  synthetic  thermal  and  millimeter  wave  images  that 
accurately  model  the  environmental  conditions  and  can  then  be  processed 
through  the  sensor  and  sensor  logic  to  produce  results  representative  of 
those  from  a  weapon  system  captive  flight  demonstration,  all  at  a  much 
lower  cost.  An  added  benefit  of  this  analytical  procedure  allows  the  envi¬ 
ronmental  conditions  to  be  changed  so  that  the  sensor  logic  may  be  evalu¬ 
ated  over  a  variety  of  background  and  weather  conditions  quickly  and 
efficiently. 
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Objectives 

The  objectives  of  this  report  are  as  follows: 

a.  To  conduct  an  analysis  of  thermal  data  collected  by  the  U.S.  Army 
Engineer  Waterways  Experiment  Station  (WES)  during  the  Grayling  1 
field  program  15  September-30  October  1992  to  help  understand 
variations  in  image  characteristics  using  image  metrics,  and  to  present 
the  data  in  a  format  that  could  be  used  for  synthetic  image  validation 
tasks. 

b.  To  describe  in  graphical  format  the  meteorological  and  terrain  data  at 
the  time  the  IR  imagery  data  were  collected  and  correlate  measured 
data  with  meteorological  and  terrain  data. 


Scope 

The  intent  of  this  report  is  to  describe  the  analysis  of  WES  IR  imagery. 
The  data  and  results  are  presented  in  a  format  useful  for  synthetic  image 
validation  tasks.  The  final  image  data  are  stored  in  the  SWOE  program 
database  managed  by  the  SWOE  Program  Office,  Hanover,  NH,  and  made 
available  to  the  development,  test,  and  evaluation  community. 
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2  Summary  of  Image  Data 
Collected 


Image  Geometry 

Image  data  were  collected  by  WES  using  a  ground-based  system  at 
Grayling,  MI,  from  September  15  to  October  30,  1992.  Figure  1  shows  a 
photograph  of  Site  E  and  surrounding  areas  that  was  imaged  with  a  20-deg 
lens  throughout  the  field  program.  Given  the  importance  of  features  sur¬ 
rounding  the  Site  E  area,  this  study  takes  into  consideration  all  the  infor¬ 
mation  within  the  field  of  view  (FOV).  The  dominant  terrain  features  that 
composed  this  scene  are  a  large  oak  tree  (deciduous)  in  the  center,  three 
evergreen  trees  (coniferous)  on  the  left,  two  small  evergreen  and  one  oak 
tree  in  the  foreground,  soil  with  very  short  grass,  a  sandy  road  or  vehicle 
test  track  in  the  background,  and  a  tree  line  (mixture  of  coniferous  and  de¬ 
ciduous  trees)  just  beyond  the  test  track.  The  approximate  image  geome¬ 
try  was  an  azimuth  of  76°58'55"  (grid  north  reference),  an  elevation  angle 
of  99°47'53"  (measured  from  vertical),  and  a  slant  range  of  147.9  m  (=dis- 
tance  from  WES  camera  to  center  of  Site  E  area  imaged).  The  camera  was 
located  at  universal  transverse  Mercator  (UTM)  coordinates  687083E 
4951896N  and  at  a  height  of  17.2  m  above  the  ground  surface. 


Description  and  Summary 
of  Image  Data  Collected 

The  WES  imaging  equipment  consisted  of  a  far  infrared  (long  wave 
band  (LWB))  and  a  midinfrared  (short  wave  band  (SWB))  thermal  imager. 
All  the  analysis  on  the  SWB  imagery  includes  the  reflected  and  emitted 
component.  An  LWB  and  SWB  IR  image  of  Site  E  and  surrounding  area 
are  shown  in  Figures  2  and  3,  respectively.  The  WES  thermal  cameras 
had  20-deg  FOV  lenses;  the  specifications  for  these  cameras  are  shown  in 
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Table  1 .  Appendix  A  offers  a  general  explanation  of  the  image  data  collec¬ 
tion  procedure;  another  report  provides  a  more  in-depth  explanation. 

The  imaging  schedule  (see  Table  2)  was  arranged  so  that  107  2-hr 
image  data  collection  missions  would  be  accomplished  during  the  SWOE 
Grayling  1  effort.  One  image  frame  was  collected  per  second  for  10  sec. 
These  imaging  periods  were  conducted  at  5-min  intervals  throughout  the 
established  2-hr  data  collection  period.  For  program  purposes,  every  5-min 
time  count  was  known  as  a  pass  (or  section);  at  the  end  of  a  2-hr  imaging, 
there  were  25  passes.  One  particular  pass  and  frame  was  randomly  se¬ 
lected  and  designated  the  critical  frame.  All  the  analysis  in  these  reports 
is  based  on  the  critical  frame. 

The  107  data  collection  missions  were  executed  under  a  broad  variety 
of  meteorological  conditions.  Another  report  gives  a  summary  of  meteoro¬ 
logical  data.^  Of  the  total  missions,  52  percent  were  accomplished  during 
nighttime  conditions.  Figure  4  illustrates  a  frequency  histogram  of  the  air 
temperature  values  during  the  critical  frames.  The  figure  reflects  that  14  per¬ 
cent  of  the  missions  were  executed  under  temperatures  below  freezing, 

41  percent  at  air  temperatures  between  0  and  10  °C,  42  percent  at  air  tem¬ 
peratures  between  10  and  20  °C,  and  3  percent  at  air  temperatures  above 
20  °C.  By  04  October,  the  leaves  on  the  deciduous  trees  within  the  site 
had  started  to  turn  color  (red);  by  13  October,  the  leaves  were  completely 
red.  Between  the  dates  16  OctoW-21  October,  there  were  some  critical 
frames  with  either  snowfall/snow  precipitation,  snow  cover  on  the  ground 
and  snow  collected  on  the  trees  or  no  snow  at  all. 


1  Hahn,  C.  D.,  and  Berry,  T.  E.  (1994).  “Grayling  1  site  characterization  and  data  summary,” 
Technical  Report  prepared  by  the  U.S.  Army  Engineer  Waterways  Experiment  Station,  Vicksburg, 
MS,  for  the  Smart  Weapons  Operability  Enhancement  Joint  Test  and  Evaluation  Program  Office, 
Hanover,  NH. 
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Imagery  Analysis 
Procedures 


Image  Metrics  Computed 

Image  metrics  were  used  to  quantify  the  distribution  of  specific  fea¬ 
tures  within  a  digital  image.  Nine  different  scene  metrics  were  computed 
in  this  study.  All  of  these  characterize  the  data-space  distribution  of  tem¬ 
perature  in  degrees  Celsius.  Processing  was  initiated  by  generating  histo¬ 
grams  of  digital  level  values  within  the  designated  region.  Eight  measures 
are  computed  from  the  histogram:  the  minimum  value  (MIN),  the  5-percentile 
value  (PERC_05),  the  median  value  (MEDIAN),  the  mode  (MODE),  the 
95-percentile  value  (PERC_95),  the  maximum  value  (MAX),  and  the  dif¬ 
ference  between  the  95-  and  5-percentile  (RNG_90).  The  first  and  second 
moments  of  the  distribution  of  digital  level  values  within  the  designated 
region  (mean  and  standard  deviation)  are  also  computed.  Results  were 
converted  to  temperature  by  substituting  them  (and  camera  calibration 
constant)  into  Planck’s  equation. 


Phase  I:  Image  Quality  Assurance  Analysis 

A  procedure  was  employed  to  verify  the  accuracy  of  the  radiometric 
temperature  estimates  and  to  ensure  that  the  manual  settings  of  all  images 
were  within  dynamic  range.  This  procedure  also  allowed  identification  and 
elimination  of  image  data  with  noise  other  than  that  resulting  from  the  scan¬ 
ner.  This  image  noise  was  possible  given  the  numerous  external  electric 
sources  operating  at  the  same  time  at  the  site  where  data  were  collected. 
Figure  5  shows  a  flowchart  describing  the  several  image  quality  tests  used 
to  ensure  that  the  final  imagery  set  was  within  calibration,  within  dynamic 
range,  and  without  noise.  Imagery  that  did  not  pass  these  tests  was  dis¬ 
carded.  At  the  end,  a  confirmation  analysis  was  performed  by  processing 
WES  and  Atmospheric  Research  Laboratory  (ARL)  IR  data  (both  wave 
bands)  and  comparing  the  mean  temperature  and  standard  deviation  of  the 
features  for  all  the  critical  frames.  Assuming  that  both  systems  are  operat¬ 
ing  at  factory  calibration,  the  mean  temperature  difference  of  the  features 
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should  be  within  ±3  °C  and  the  standard  deviation  difference  within 
±0.5  °C. 

At  the  beginning  and  end  of  each  of  the  107  missions  (refer  to  Appen¬ 
dix  A  for  more  details),  an  IR  image  of  the  four  active  blackbodies  was 
taken,  along  with  the  actual  (truth)  temperature  of  each  blackbody.  The 
purpose  was  to  implement  the  first  image  quality  test,  which  consists  of 
verifying  that  the  absolute  error  between  the  actual  temperature  and  esti¬ 
mated  radiometric  temperature  is  within  ±3  °C,  which  was  the  criteria  for 
acceptance.  A  linear  regression  analysis  was  applied  to  the  data  that  did 
not  meet  the  criteria  for  acceptance.  Data  were  accepted  if  they  met  the 
criteria  for  acceptance  after  the  linear  regression.  Otherwise,  the  data 
were  discarded.  This  analysis  was  applied  to  blackbody  data  collected  be¬ 
fore  120CT92;  14:00  because  the  remaining  data  was  considered  spurious. 
The  next  paragraphs  will  show  that  IR  data  (both  wave  bands)  collected 
after  120CT92: 14:00  met  calibration  criteria. 

Figure  6a  shows  a  plot  of  the  absolute  error  versus  date  for  all  the  ac¬ 
tive  blackbody  data  in  the  LWB  collected  throughout  the  field  exercise. 
Each  of  the  plots  shows  a  band  (horizontal  lines)  of  ±3  °C,  the  calibration 
criteria  for  acceptance.  This  plot  indicates  that  most  of  the  data  met  the 
criteria  for  acceptance.  Figure  6b  shows  a  frequency  histogram  of  the  ab¬ 
solute  error,  indicating  that  99  percent  of  the  data  met  the  criteria  for  ac¬ 
ceptance.  Therefore,  the  factory  calibration  of  the  LWB  camera  needed 
no  correction. 

Figure  7a  shows  a  plot  of  the  absolute  error  versus  date  for  all  the 
blackbody  data  in  the  SWB  collected  during  the  field  exercise.  This  plot 
indicates  that  most  of  the  data  is  within  ±3  °C,  with  the  exception  of  the 
imagery  collected  before  29SEP92:02:00.  Figure  7b  is  a  frequency  histo¬ 
gram  of  the  absolute  error,  showing  that  93  percent  of  the  data  are  within 
the  criteria  for  acceptance.  A  linear  regression  was  performed  on  the  data 
collected  before  29SEP92:02:00  to  obtain  an  equation  to  correct  the  data. 
Figure  8  offers  the  result  of  this  analysis  (Figure  8a)  where  98  percent  of 
the  data  (Figure  8b)  subsequently  satisfied  the  criteria  for  acceptance.  Im¬ 
agery  collected  before  29SEP92:02:00  was  corrected  using  this  equation: 
(NEW_TEMP=0.984*OLD_TEMP-2.269). 

As  part  of  the  second  image  quality  test,  all  the  imagery  collected  were 
checked,  given  that  cameras  require  manual  setting  of  the  levels  and  ranges, 
to  ensure  that  the  imagery  were  within  dynamic  range.  Images  with  more 
than  2  percent  of  the  brightness  values  (8  bit  radiometric  resolution)  less 
than  5  or  greater  than  250  were  rejected. 

The  third  and  last  image  quality  test  consisted  of  visually  identifying 
image  data  with  noise  other  than  the  noise  due  to  the  scanner.  Once  identi¬ 
fied,  these  image  data  were  processed  using  a  Fast  Fourier  Transform 
(FFT)  transforming  them  to  the  frequency  domain.  Low  pass  filter  was 
then  applied  to  eliminate  all  undesired  high  frequencies  (noise).  The 
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image  data  were  then  transformed  back  to  the  spatial  domain.  If  the  noise 
test  failed,  the  image  data  were  rejected. 

At  the  end,  a  confirmation  analysis  was  performed  by  processing  WES 
and  ARL IR  data  (both  wave  bands)  and  comparing  the  feature’s  mean 
temperature  and  standard  deviation  for  all  the  critical  frames.  Assuming 
that  both  systems  are  operating  at  factory  calibration,  the  feature’s  mean 
temperature  difference  should  be  within  ±3  °C  and  the  feature’s  standard 
deviation  difference  within  ±0.5  °C.  Figures  9-12  show  for  the  features 
grassy  area,  coniferous  tree,  deciduous  tree,  and  test  track,  respectively,  histo¬ 
grams  of  the  difference  in  mean  temperature  and  standard  deviation  between 
WES  and  ARL  IR  data.  Figures  9a- 12a  show  a  histogram  for  the  LWB  data 
of  frequency  versus  feature  mean  temperature  difference.  Figures  9b- 12b 
show  a  histogram  for  the  LWB  data  of  frequency  versus  feature  standard 
deviation  difference.  Figures  9c-12c  show  a  histogram  for  the  SWB  data 
of  frequency  versus  feature  mean  temperature  difference.  Figures  9d-12d 
show  a  histogram  for  the  SWB  data  of  frequency  versus  feature  standard  de¬ 
viation  difference.  These  histograms  reflect  that,  for  any  feature/wave  band 
combination,  the  mean  temperature  difference  is  within  ±3  °C  (WES  and 
ARL  absolute  temperature  accuracy  is  ±3  “C  and  ±1  °C,  respectively).  The 
standard  deviation  difference  is  within  ±0.5  °C.  After  confirmation  results 
were  examined,  the  LWB  and  SWB  IR  data  were  used  for  further  analysis. 

Table  3  summarizes  data  based  on  107  test  missions.  In  the  LWB, 

83  percent  of  the  data  was  considered  acceptable;  in  the  SWB,  79  percent 
of  the  data  was  considered  acceptable. 


Phase  II:  Overall  Scene  Analysis 

Appendix  B  shows  a  listing  of  the  image  metric  database  for  the  critical 
frames.  The  information  contained  in  the  listing  includes  the  date-time 
when  the  critical  image  was  collected  (IMAGE_DT),  date-time  when  the 
mission  was  started  (MISSN_DT),  wave  band  to  which  the  image  belongs 
(WAVEBAND),  mission  number  (MISSION),  pass  number  (PASS),  frame 
number  (FRAME),  and  nine  image  metrics. 

One  of  the  first  steps  when  analyzing  IR  image  data  is  to  determine  the 
mean  temperature  and  variability.  Figure  13  shows  a  three-dimensional  (3-D) 
plot  of  the  frequency  count  of  the  image  mean  temperature  and  standard  devia¬ 
tion  (degrees  Celsius)  for  all  the  critical  frame  data.  For  the  LWB  data  (Fig¬ 
ure  13a),  83  percent  of  the  image  data  had  a  mean  temperature  between  0.0 
and  20.0  °C.  Also,  80  percent  of  the  image  data  show  very  little  thermal  vari¬ 
ation  with  standard  deviation  between  0.0  and  1.0  °C.  The  two  highest 
peaks  had  a  mean  and  standard  deviation  of  the  following  (respectively); 

(1)  0  and  1  °C  (8  percent  of  data). 

(2)  7.5  and  1  °C  (10  percent  of  data). 
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In  the  SWB  data  (Figure  13b)  90  percent  of  the  image  data  had  a  mean 
temperature  between  5.0  and  20.0  °C.  Also,  86  percent  of  the  image  data 
showed  very  little  thermal  variation,  with  standard  deviation  between  0.0 
and  1.0  °C.  The  six  highest  peaks  had  a  mean  and  standard  deviation  of 
the  following  (respectively): 

(1)  5  and  0  °C  (9  percent  of  data). 

(2)  12.5  and  0  °C  (10  percent  of  data). 

(3)  20  and  0  °C  (9  percent  of  data). 

(4)  10  and  1  °C  (9  percent  of  data). 

(5)  12.5  and  1  °C  (9  percent  of  data). 

(6)  15  and  1  °C  (9  percent  of  data). 

To  illustrate  variability.  Figure  14  shows  a  frequency  count  histogram 
of  the  temperature  range  (RNG_90)  of  all  the  data  processed  for  both 
wave  bands.  In  the  LWB,  90  percent  of  the  data  had  a  temperature  range 
of  6  °C  or  less,  while  90  percent  of  the  SWB  data  showed  a  temperature 
range  of  5  °C  or  less. 


Phase  III:  Scene  Component  Analysis 

This  analysis  consisted  of  selecting  several  features/areas  of  interest 
(FOI  or  AOI)  that  were  considered  homogeneous  within  the  scene  (see  Fig¬ 
ure  1).  Mean  temperature  and  standard  deviation  were  first  computed  for 
the  AOI;  analysis  included  a  large  red  oak  tree  (deciduous)  near  the  center 
of  the  scene,  the  smaller  groups  of  evergreen  trees  (coniferous)  to  the  left 
of  the  oak  tree,  a  grassy  area  in  the  foreground,  and  a  stretch  of  the  test 
track  in  the  background  of  the  scene.  These  statistics  were  computed 
using  all  the  pixels  within  the  polygons  enclosing  each  of  the  features.  A 
database  was  generated  with  the  mean  temperature  and  the  standard  devia¬ 
tion  of  the  features  (grassy  area,  coniferous  tree,  deciduous  tree,  and  test 
track)  in  Site  E  and  surrounding  areas. 

For  each  wave  band,  the  air  temperature  and  the  feature’s  mean  temper¬ 
atures  bounded  by  one  standard  deviation  were  plotted  (Figures  15a  and 
15b,  respectively).  In  both  wave  bands,  the  grassy  area  followed  by  the 
test  track  exhibited  warmer  temperatures  and  more  thermal  variability  than 
the  deciduous  and  coniferous  trees.  The  deciduous  and  coniferous  trees  ex¬ 
hibited  very  similar  temperatures  throughout  the  data  collection  time.  After 
07  October,  all  the  features  exhibited  minimal  thermal  variability;  during 
the  same  time,  the  air  temperature  remained  cool  (average  5  °C)  until 
23  October.  In  general,  comparing  the  plots  for  each  wave  band  indicates 
that  the  SWB  data  exhibited  warmer  temperatures  and  more  thermal 
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variability  than  the  LWB  data.  Comparing  the  air  temperature  with  the 
feature’s  mean  temperature  indicates  that  the  temperature  of  the  coniferous 
and  deciduous  trees  tracked  the  air  temperature  very  closely,  although  it  was 
more  noticeable  in  the  LWB  than  in  the  SWB.  Appendix  B  shows  a  listing 
of  the  image  metrics  computed  on  the  entire  image  and  the  five  features 
composing  the  image. 


Phase  IV:  Within  Pass  Scene  Anaiysis 


The  purpose  of  this  analysis  was  to  determine  whether  the  scene  changed 
significantly  during  the  10-sec  imaging  period.  This  analysis  consisted  of 
performing  pairwise  comparison  of  the  cumulative  percent  distribution  of 
all  possible  images  within  the  10-sec  period.  The  Kolmogorov-Smimov* 
like  test  was  used  to  detect  differences.  Results  were  plotted  as  average 
Smirnov  test  statistics  as  a  function  of  a  time  lag  between  images,  and  the 
trend  of  the  line  was  used  to  determine  whether  these  10  images  change 
significantly  with  time.  The  following  procedure  was  used  for  10  images 
collected  10  sec  apart; 


a.  A  frequency  histogram  of  the  digital  value  distribution  of  each  of  the 
10  images  was  first  generated. 


b.  The  distributions  were  then  normalized  by 
constructing  a  cumulative  percent  histogram  from 
the  frequency  histogram  of  the  10  images. 

c.  Using  the  cumulative  percent  histogram,  the  greatest 
vertical  distance  (T)  was  computed  for  every 
possible  combination.  Figure  16  is  an  illustration 
of  a  frequency  histogram  and  cumulative  percent 
histogram  for  two  images.  Table  4  was  produced 
by  computing  T  for  every  possible  combination 
among  all  10  images. 

d.  The  adjacent  observations  were  obtained  for  the 
nine  possible  lag  times. 

e.  All  observations  were  averaged  for  a  particular  lag 
time,  and  a  plot  was  generated  of  the  average  T 
versus  lag  time. 

/.  The  trend  (of  the  line)  was  analyzed  to  determine 
whether  the  line  changed  significantly  in  10  sec 
and  whether  or  not  it  was  dependent  on  time. 


Lag  time 
(seconds) 

Number  of 
observations 

1 

9 

2 

3 

7 

6 

5 

5 

6 

4 

7 

3 

8 

2 

9 

1 

Total  number  of 
observations 

45 

1  Conover,  W.  J.  (1971).  Practical  nonparametrics  statistics.  John  Wiley  and  Sons,  Inc.,  New 
York. 
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As  part  of  the  analysis,  the  missions  were  also  grouped  by  the  type  of 
weather  conditions  in  which  they  occurred.  The  four  weather  condition 
groups  were  sunny  day,  partly  cloudy  day,  cloudy  day,  and  nighttime.  For 
each  group,  three  image  missions  were  selected;  critical  passes  (10  images 
each)  were  analyzed  for  each  of  those  selected. 

Figures  17  and  18  show,  for  the  LWB  and  SWB,  respectively,  a  plot  for 
each  of  the  four  weather  condition  groups.  Each  plot  shows  the  trend  of 
Twith  respect  to  time  for  each  critical  pass.  In  the  SWB  (Figure  18),  the 
trend  illustrates  that  the  critical  pass  images  from  mission  No.  71  (a 
partly  cloudy  day)  changed  significantly  with  time.  All  the  other  critical 
pass  images  at  different  weather  conditions  showed  no  change  with  time. 
The  same  observations  were  noticed  in  the  LWB  (Figure  17). 
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4  Correlation  of  Measured 
Data  with  Terrain  and 
Meteorological  Data 


IR  data  were  collected  under  a  broad  variety  of  meteorological  condi¬ 
tions  that  affects  the  IR  signatures  of  the  imaged  features  within  Site  E 
and  surrounding  areas  (Figure  1).  Some  meteorological  factors  that  oc¬ 
curred  during  the  data  collection  were  dense  fog,  rain  and  snow  precipita¬ 
tion.  These  factors  affect  (block)  the  feature’s  infrared  energy  being 
measured  by  the  scanner.  High  content  of  soil  moisture  because  of  rain 
and  snow  precipitation  as  well  as  snow  accumulation  on  trees,  grass,  and 
ground  also  affects  IR  signatures  on  natural  background  materials.  Dur¬ 
ing  the  data  collection  period,  there  was  a  wide  variety  of  sunny,  partly 
cloudy,  and  cloudy  days.  Air  temperature,  relative  humidity,  wind  speed, 
and  wind  direction  also  exhibited  a  wide  range  of  values.  The  purpose  of 
this  section  is  to  illustrate  by  graphics  and  tables  the  meteorological  and 
terrain  conditions  that  occurred  during  the  collection  of  the  IR  imagery. 

In  addition,  this  section  will  correlate  the  mean  temperature  and  standard 
deviation  of  the  critical  frame  imagery  with  the  meteorological  and  terrain 
conditions. 


Measured  Data 


Figure  19  illustrates,  for  most  of  the  107  critical  frames,  the  image 
mean  apparent  temperature  bounded  by  the  standard  deviation  in  the  LWB 
and  SWB.  The  image  mean  apparent  temperature  for  both  wave  bands  ex¬ 
hibited  a  wide  range  of  temperatures  fluctuating  approximately  between 
-7  and  27  °C.  Cool  temperatures  are  grouped  between  missions  No.  70 
(12  October  1992)  and  No.  100  (22  October  1992),  while  warm  tempera¬ 
tures  are  grouped  between  missions  No.  15  (19  September  1992)  and 
No.  55  (06  October  1992).  The  imagery  in  both  wave  bands  exhibited  a 
maximum  thermal  variability  between  missions  No.  10  (17  September 
1992)  and  No.  55  (06  October  1992). 
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A  scene  component  analysis  was  performed  in  which  each  of  the  fea¬ 
tures  was  examined  individually  (See  Scene  Component  Analysis  section 
for  more  information).  Figure  15  shows  the  mean  temperature  of  the  fea¬ 
tures  bounded  by  standard  deviation  for  the  four  features  composing  the 
image  (grassy  area,  coniferous  tree,  deciduous  tree,  and  test  track).  The 
mean  temperature  for  all  the  features  fluctuates  considerably  throughout 
the  45  days  of  data  collection  (-8  to  30  °C).  The  features  exhibit  more 
thermal  variability  in  the  SWB  data  than  in  the  LWB  data. 


Meteorological  and  Terrain  Data 

During  the  test,  the  WES  team  recorded  most  of  the  daytime  missions 
on  VHS  videotapes.  These  videotapes  were  used  to  make  color  hardcopy 
pictures  of  Site  E  and  surrounding  areas  at  the  moment  the  critical  frame 
was  collected  (WES  visual).  Figure  20  illustrates  physical  changes  that 
occurred  at  Site  E  and  surrounding  areas  throughout  the  test  period.  The 
date  and  time  are  included  on  each  visual  photo. 

Some  of  the  most  important  events  that  occurred  were  as  follows: 

a.  20SEP,  15:28  -  Leaves  on  deciduous  trees  and  others  are  green. 

b.  21SEP,11:57  -  A  dense  foggy  day. 

c.  05OCT,  15:43  -  Leaves  on  deciduous  trees  beginning  to  turn  red. 

d.  120CT,  10:48  -  Most  of  the  deciduous  tree  leaves  are  red 

e.  18OCT,08:43  -  Snow  covers  the  ground,  accumulated  on  trees. 

/.  19OCT,08:58  -  Snow  precipitation. 

g.  190CT,17:58  -  Snow  melted  on  the  bare  ground  patches. 

h.  20OCT,  12:00  -  Snow  precipitation. 

i.  210CT,1 1:34  -  Snow  accumulated  on  the  ground,  trees,  and  grass. 

j.  220CT,16:19  -  Normal  sunny  day  conditions. 

Figure  21  shows  the  WES-measured  meteorological  conditions  through¬ 
out  the  test  period.  The  total  solar  radiation  (0.4-  to  0.7-p,m  range;  an¬ 
other  report  provides  instrument  specifications^)  measured  was  used  to 


1  Hahn,  C.  D.,  and  Beiry,  T.  E.  (1994).  “Grayling  1  site  characterization  and  data  summary,” 
Technical  Report  prepared  by  the  U.S.  Army  Engineer  Waterways  Experiment  Station,  Vicksburg, 
MS,  for  the  Smart  Weapons  Operability  Enhancement  Joint  Test  and  Evaluation  Program  Office, 
Hanover,  NH. 
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illustrate  cloud  cover.  Solar  radiation  is  the  real  driving  factor  during  the 
day,  especially  for  the  SWB  sensor  if  the  hemispherical  albedo  is  rela¬ 
tively  high.  The  test  started  and  ended  with  some  partly  cloudy  days  (Fig¬ 
ure  21a).  During  the  test,  there  were  many  sunny  days  as  well  as  partly 
cloudy  and  cloudy  days.  The  dates  25-27  September  are  good  samples  of 
sunny  days;  the  dates  15-17  September  were  partly  cloudy  days.  The 
dates  21  September,  15  October,  and  20  October  were  very  cloudy  days. 
From  the  beginning  of  the  test,  the  air  temperature  (Figure  21a)  exhibited 
peaks  (at  noon)  and  valleys  (early  morning  and  late  evening)  until  08  Oc¬ 
tober.  Those  days  exhibited  some  of  the  warmer  air  temperatures.  Be¬ 
tween  09  October  and  22  October,  the  air  temperature  decreased  and 
increased  with  a  small  slope  and  eventually  dropped  below  freezing.  At 
the  end  of  the  test  (23  October),  the  air  temperature  was  quite  high. 

The  barometric  pressure  (Figure  21b)  showed  very  little  fluctuation 
(970  to  1,010  mb)  during  the  duration  of  the  test.  On  sunny  days,  the  rela¬ 
tive  humidity  (Figure  21b)  dropped  to  40  percent,  while  on  cloudy  days 
dropped  to  90  percent.  The  wind  speed  (Figure  21c)  fluctuated  between 
0.2  and  3.5  m/sec.  The  dates  with  the  higher  wind  speed  occurred  between 
16  September  and  09  October.  Meanwhile,  the  dates  with  the  slower  wind 
speed  occurred  on  the  dates  15  September,  29  September,  30  September, 
and  15  October.  The  wind  direction  (Figure  21c)  most  of  the  time  blew 
from  the  west  (0°=NORTH  and  90°=EAST). 

Visibility  (Figure  21d)  varied  appreciably  within  a  24-hr  period.  For 
example,  during  the  first  8  hr  of  15  September,  the  visibility  was  a  very  low 
0.2  km;  then  it  quickly  changed  to  22  km.  There  were  a  few  days  with 
rain  as  well  as  snow  precipitation  (Figure  2 Id).  Most  of  the  rain  occurred 
on  17  Sepember  (35  mm/hr),  meanwhile  the  dates  16  October,  18  October, 
and  20  October  exhibited  a  considerable  amount  of  snow  precipitation. 

Figure  22  shows  the  instantaneous  meteorological  conditions  at  the  mo¬ 
ment  the  critical  frames  were  collected.  The  air  temperature  (Figure  22a) 
fluctuated  between  -5  and  25  °C  with  a  mean  temperature  of  9.14  °C  and  a 
variability  of  7.12  °C.  Also,  52  percent  of  the  missions  were  executed  at 
night  or  during  low  levels  of  solar  radiation  (Figure  22a).  Relative  humidity 
(Figure  22b)  fluctuated  between  100  and  44  percent.  Of  the  critical 
frames,  44  percent  exhibited  relative  humidity  of  100  percent,  and  74  percent 
exhibited  relative  humidity  greater  than  80  percent.  The  barometric  pressure 
(Figure  22b)  exhibited  a  small  range  of  values  fluctuating  between  980 
and  1,005  mb.  The  average  wind  speed  (Figure  22c)  was  1.5  m/sec  with 
wind  speed  varying  between  0  and  3  m/sec.  The  direction  in  which  the 
wind  was  blowing  (Figure  22c)  for  each  critical  frame  showed  a  spread  be¬ 
tween  0  and  360°  (0°=NORTH  and  9°=EAST).  Very  few  missions  exhib¬ 
ited  either  snow  or  rain  precipitation  (Figure  22d).  Rain  precipitation 
occurred  during  mission  No.  8  (12mm/hr),  while  mission  No.  92  had  con¬ 
siderable  snow  precipitation  (6.2  mm/hr).  Appendix  C  shows  a  listing  of 
all  the  missions  and  the  instantaneous  meteorological  conditions,  accumu¬ 
lated  (last  12  hr)  rain  and  snow  precipitation,  average  (for  the  last  12  hr) 
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solar  radiation  and  air  temperature,  and  image  mean  temperature  and 
standard  deviation. 

Visibility  data,  precipitation  data,  and  WES  visual  (video)  data  were  used 
to  detect  dense  fog,  snow,  or  rain  precipitation  during  the  critical  frames.  Al¬ 
though  the  terrain  area  imaged  was  only  a  short  distance  (150  m),  visibil¬ 
ity  with  less  than  5  km  has  some  effect  on  the  measured  IR  signatures. 
Table  5  lists  all  the  missions  where  the  visibility  was  less  than  5  km.  The 
information  in  this  table  contains  mission  number,  collection  time,  visibil¬ 
ity  distance,  visual  (video)  data  availability,  and  type  of  atmospheric  con¬ 
dition  along  the  transmittance  path. 

Precipitation  data  and  soil  moisture  data  were  used  to  determine  the 
possibility  of  the  ground  being  wet  during  the  critical  frame  collection. 

The  average  solar  radiation,  air  temperature,  and  accumulated  precipita¬ 
tion  were  computed  (Figure  23)  for  the  last  12  hr  prior  to  the  critical 
frames.  There  is  a  high  possibility  that  the  ground  remained  wet  during 
some  of  the  missions  between  No.  61  and  No.  95  because  of  precipitation 
accumulation  and  low  averages  of  both  solar  radiation  and  air  temperature 
(during  the  last  12  hr).  Table  6  shows  the  missions  with  accumulated  pre¬ 
cipitation  greater  than  5  mm/hr  during  the  previous  12  hr  and  provides 
data  on  the  average  solar  radiation  and  air  temperature  during  the  previous 
12  hr  and  the  Troxler  and  Speedy  soil  moisture  data  for  Sites  E1/E2. 

The  Site  E  area  was  divided  (in  two  parts)  where  the  left  side  was  re¬ 
ferred  to  as  Site  El  and  the  right  side  as  Site  E2.  Soil  moisture  data  were 
collected  at  each  site  using  the  Troxler  Model  4640  Thin  Layer  Density 
Gauge  and  the  Soiltest  Speedy  Moisture  Gauge.  The  Troxler  device  deter¬ 
mines  soil  moisture  by  measuring  the  backscattering  of  low-level  radiation 
from  the  surface  of  the  soil.  The  Soiltest  Speedy  Moisture  Gauge  deter¬ 
mines  the  moisture  by  combining  a  measured  amount  of  soil  with  a  mea¬ 
sured  amount  of  calcium  carbide.  The  moisture  in  the  soil  reacts  with  the 
calcium  carbide  to  produce  acetylene  gas.  A  pressure  gauge  on  the 
Speedy  then  reads  the  gas  pressure,  and  the  reading  is  converted  to  a  per¬ 
cent  moisture.  An  important  distinction  between  these  two  instruments  is 
that  the  Troxler  measures  the  moisture  in  a  thin  soil  layer  at  or  near  the 
surface,  while  the  Speedy  determines  the  moisture  based  on  a  specific 
depth  volume  of  soil.  Speedy  soil  samples  were  collected  from  the  area 
measured  with  the  Troxler  device  within  a  0-  to  2.5-cm  depth  layer.  Fig¬ 
ure  24  illustrates  the  soil  moisture  data  collected  at  Sites  E1/E2  with  both 
instruments.  See  “Grayling  1  Site  Characterization  and  Data  Summary” 
for  more  information  about  soil  composition,  soil  moisture  data,  and 
instrumentation.  ^ 


1  Hahn,  C.  D.,  and  Berry,  T.  E.  (1994).  “Grayling  1  site  characterization  and  data  summary,” 
Technical  Report  prepared  by  the  U.S.  Army  Engineer  Waterways  Experiment  Station,  Vicksburg, 
MS,  for  the  Smart  Weapons  Operability  Enhancement  Joint  Test  and  Evaluation  Program  Office, 
Hanover,  NH. 
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Chapter  4  Correlation  of  Measured  Data  with  Terrain  and  Meteorological  Data 


Snow  precipitation  data  and  WES  visual  data  were  used  to  determine  the 
possibility  of  snow  precipitation  along  the  path  during  the  critical  frame 
collection.  It  could  not  be  accurately  determined  whether  there  was  snow 
precipitation  for  those  critical  frames  without  WES  visual  data.  For  these 
cases,  the  amount  of  snow  precipitation,  within  the  hour  when  the  critical 
frame  was  collected,  was  used  as  an  indicator.  The  following  missions  ex¬ 
hibited  snow  precipitation. 


Mission 

Number 

Coiiection  Date-Time 

Precipitation 
Rate,  mm/hr 

Source  of  information 

82 

160CT92:1 7:00:06 

1.98 

Visual  observation  and  snow 
precipitation  gauge 

83 

170CT92:07:10:10 

0.28 

Snow  precipitation  gauge 

88 

19OCT92:03:25:09 

0.04 

Snow  precipitation  gauge 

89 

190CT92:09:00:08 

0.03 

Visual  observation  and  snow 
precipitation  gauge 

92 

20OCT92:1 2:00:02 

6.71 

Visual  observation  and  snow 
precipitation  gauge 

Snow  precipitation  data  and  WES  visual  data  were  used  to  determine 
whether  there  was  snow  covering  the  terrain  features  (trees,  grass,  and 
bare  ground)  at  the  critical  frame  collection.  Table  7  lists  the  missions 
and  features  containing  snow.  The  amount  of  snow  accumulated  by  each 
feature  could  not  be  determined. 


Chapter  4  Correlation  of  Measured  Data  with  Terrain  and  Meteorological  Data 
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5  Summary  of  Results 


The  WES  LWB  IR  camera  needed  no  calibration  correction  because  the 
camera  was  operating  within  factory  specification  (±3  °C).  A  linear  re¬ 
gression  was  performed  to  obtain  an  equation  that  would  correct  the  WES 
SWB  infrared  data  so  that  the  blackbody  temperature  error  would  be 
within  ±3  °C.  Using  that  equation  corrected  the  SWB  IR  data  from  93  to 
98  percent  within  ±3  °C.  WES  IR  imagery  collected  at  Grayling  1  exer¬ 
cise  showed  that  83  and  79  percent,  respectively,  of  the  LWB  and  SWB 
data  were  considered  valid. 

An  analysis  was  performed  by  processing  WES  and  ARL  IR  data  (both 
wave  bands)  and  comparing  the  mean  temperature  and  standard  deviation 
of  the  features  for  all  the  critical  frames.  The  results  showed  that  for  any 
feature/wave  band  combination,  the  mean  temperature  difference  is  within 
±3  °C  (WES  and  ARL  absolute  temperature  accuracy  is  ±3  and  ±1  °C,  re¬ 
spectively).  The  standard  deviation  difference  is  within  ±0.5  °C. 

Several  global  image  metrics  were  computed  and  stored  in  a  database 
for  the  Grayling  1  imagery.  These  image  metrics  include  minimum,  maxi¬ 
mum,  mean,  median,  mode,  5-percentile,  95-percentile,  range-90,  and  stan¬ 
dard  deviation.  In  both  wave  bands,  the  terrain  scene  measured  indicated 
very  little  thermal  variability. 

In  the  LWB,  83  percent  of  the  WES  imagery  showed  a  mean  tempera¬ 
ture  between  0  and  20  °C.  Also,  80  percent  of  the  imagery  had  a  standard 
deviation  between  0.0  and  1 .0  °C.  In  addition,  90  percent  of  the  data 
showed  a  temperature  range  of  6  °C  or  less. 

In  the  SWB,  90  percent  of  the  imagery  showed  a  mean  temperature  be¬ 
tween  5  and  20  °C.  Also,  86  percent  of  the  imagery  had  a  standard  devia¬ 
tion  between  0.0  and  1.0  °C.  Moreover,  90  percent  of  the  data  indicated  a 
temperature  range  of  5  °C  or  less. 

A  database  was  generated  with  the  mean  temperature  and  standard  devi¬ 
ation  of  several  natural  background  features  (grassy  area,  coniferous  tree, 
deciduous  tree,  and  road  or  test  track)  within  Site  E  and  surrounding 
areas.  This  database  is  considered  useful  for  understanding  the  variations 
in  IR  image  signatures  to  be  used  in  SWOE  synthetic  image  validation 
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Chapter  5  Summary  of  Results 


tasks.  In  both  wave  bands,  the  grassy  area  followed  by  the  test  track  ex¬ 
hibited  warmer  temperatures  and  more  thermal  variability  than  the  conifer¬ 
ous  and  deciduous  trees.  Also,  the  coniferous  and  deciduous  trees 
exhibited  very  similar  temperatures.  The  SWB  data  exhibited  warmer  tem¬ 
peratures  and  more  thermal  variability  than  the  LWB  data. 

With  the  exception  of  1  case  in  11,  a  Kolmogorov-Smimov  like  test 
showed  no  time-dependent  changes  in  the  imagery  collected  within  10-sec 
sampling  periods  for  both  wave  bands. 

IR  data  were  collected  under  a  broad  variety  of  meteorological  condi¬ 
tions  that  affected  the  IR  signatures  of  the  imaged  terrain  features  (grassy 
area,  trees,  test  track,  etc.)  within  Site  E  and  surrounding  areas.  Some  of 
the  meteorological  factors  that  occurred  during  the  data  collection  mis¬ 
sions  were  dense  fog,  rain,  and  snow  precipitation.  High  soil  moisture 
content  because  of  rain  and  snow  precipitation  as  well  as  snow  accumula¬ 
tion  also  affected  measured  IR  signatures  of  terrain  features.  During  the 
data  collection  period,  there  was  a  wide  variety  of  sunny,  partly  cloudy, 
and  cloudy  days.  Air  temperature,  relative  humidity,  wind  speed,  and 
wind  direction  also  exhibited  a  wide  range  of  values.  Based  on  107  mis¬ 
sions,  14  percent  of  the  missions  were  executed  under  temperatures  below 
freezing,  41  percent  at  air  temperatures  between  0  and  10  °C,  42  percent 
at  air  temperatures  between  10  and  20  °C,  and  3  percent  at  air  tempera¬ 
tures  above  20  °C.  Also,  52  percent  of  the  missions  were  accomplished 
during  nighttime  conditions.  Each  of  these  parameters  are  associated  with 
the  critical  frame. 

WES  equipment  (infrared  scanners,  meteorological  station,  global  posi¬ 
tioning  system,  soil  moisture  equipment,  and  others)  proved  to  be  reliable 
and  effective  for  site  characterization  and  measurements. 


Chapter  5  Summary  of  Results 
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Figure  1 .  Photograph  of  Site  E  area 


Figure  2.  Sample  of  Site  E  area,  LWB  IR  image  (23OCT92:12:20) 


FREQUENCY 


o)  LWS;  HISTOGRAM  OF  MEAN  TEMPERATURE  DIFTERENCE  (WES  mlnu»  ARL>  FOR  CRASSY  AREA _  b>  LW8;  HISTOGRAM  OF  STD.  DEV.  DIFFERENCE  <WES  AJ?L)  FOR  CRASST  AREA 


.  Sensor-to-sensor  comparison  between  WES  and  ARL  on  grassy  area  feature  for  both  wave  bands 


a)  LWB:  HISTOGRM><  OF  MEAN  TEMPERATURE  DIFFERENCE  (SVE5  mlnua  ARL)  FOR  CONIFEROUS  TREE _  &>  LWB;  HISTOGRAM  OF  STP.  DEV.  DIFFERENCE  <WES  fntnu>  ARL)  FOR  CONIFEROUS  TREE 


■sensor  comparison  between  WES  and  ARL  on  coniferous  tree  feature  for  both  wave  bands 


q)  LW8:  HISTOGRAM  OF  MEAN  TIMPERATURE  DIFFERENCE  (WES  mlnua  ARL>  FOR  DECIDUOUS  TREE _  b>  LWB;  HISTOGRAM  OF  STD.  DEV.  DtFFERENCE  <WES  mlnu*  ARL)  FOR  DECIDUOUS  TREE 


Figure  1 1 .  Sensor-to-sensor  comparison  between  WES  and  ARL  on  deciduous  tree  feature  for  both  wave  bands 


RNG_90  (Deg.  C) 


RNG_90  (Deg.  C) 


Figure  14.  Histogram  piot  of  temperature  range  distribution  for  LWB  and  SWB  data 


Figure  1 5.  Air  temperature  and  features’  mean  temperature  bounded  by  standard  deviation  throughout  Grayling  1  test 


HISTOGRAM  OF  DIGnAL  VALUE  DISTRIBUTION  OF  TWO  IR  IMAGES 


Figure  1 6.  Within  pass  anaiysis  piot 
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36 


Figure  1 7.  Plot  of  T  versus  lag  time  at  different  weather  conditions  for  LWB  data 


Q>  MISSIONS  37,  38  AND  74  UNDER  SUNNY  DAY  CONDfTlONS _  b)  MISSIONS  34.  70  AND  71  UNDER  PARTLY  CLOODY  DAY  CONDITIONS 


versus  lag  time  at  different  weather  conditions  for  SWB  data 
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a)  IMAGE  MEAN  TEMPERATURE  BOUNDED  BY  STANDARD  DEVIATION  FOR  LWB  DATA 


Figure  1 9.  Image  mean  temperature  bounded  by  standard  deviation  for  LWB  and  SWB  data 
for  all  1 07  missions 
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20SEP92:15:28  b.  21SEP92 : 11 : 57 


39 


Physical  changes  at  Site  E  area  (Sheel 


120CT92:10:48 


40 


Figure  20.  (Sheet  2  of  3) 
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[Sheet  3  of  3) 


ES  meteorological  data  throughout  Grayling  1  test  (Sheet  1  of  4) 
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Figure  21.  (Sheet  2  of  4) 


Figure  21 .  (Sheet  3  of  4) 
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Figure  21 .  (Sheet  4  of  4) 
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Figure  23.  Meteorological  conditions  prior  to  critical  frame 


Figure  24.  WES  soil  moisture  data  for  all  1 07  missions 


Table  1 

IR  Camera  Specification 

Specification 

Wave  Band  | 

Mid-IR 

Far-IR 

Model 

Thermovision  870  system, 
infrared  camera 

Thermovision  782  system, 
infrared  camera 

Wavelength  band 

2  to  5.6  pm 

8  to  12  pm 

FOV  lens 

2.48  square  deg 

3.63  square  deg 

Screen  resolution 

1 40  by  1 40  square  pixels 

140  by  140  square  pixels 

Image  resolution 

8-bit  resolution 

8-bit  resolution 

Radiometric  sensitivity 

0.1  “C  at  30  "C  object 
temperature 

0.1  °C  at  30  "C  object 
temperature 

Radiometric  accuracy 

iSyooriS^C 

±3%or±3°C 

Table  2 

Imaging  Schedule  for  Grayling  1 
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Table  5 

Missions  with  Visibiiity  Less  Than  5  km 


Mission 

Number 


Coiiection 

Date-Time 

Visibiiity 

km 

Visuai  Data 
Avaiiabiiity 

Atmospheric 

Condition 

15SEP92:07:00:01 

0.40 

No 

Fog 

15SEP92:09:00:00 

3.40 

No 

Fog 

16SEP92:01:30:05 

3.30 

No 

Fog 

16SEP92:07:00:06 

4.10 

No 

Fog 

16SEP92:09:20:09 

4.70 

No 

Fog 

16SEP92:20:20:04 

4.10 

No 

Fog 

17SEP92:02:00:02 

3.40 

No 

Rain 

18SEP92:01:15:07 

2.20 

No 

Fog 

21  SEP92:1 2:00:05 

3.30 

Yes 

Fog 

030CT92:07:20:07 

4.10 

No 

Fog 

150CT92:05:04:10 

4.10 

No 

Fog 

1600192:00:05:04 

4.60 

No 

Fog 

1800792:08:45:09 

4.40 

Yes 

Fog/Snow 

92 


20OCT92:1 2:00:02 


0.80 


Yes 


Snow 


Table  6 

Missions  with  12-hr  Accumulated  Precipitation  Greater  than  5  mm/hr 


Table? 

Missions  with  Features  Covered  with  Snow 


Mission 

Number 

Coiiection 

Date-Time 

• 

Grassy  Area 
Covered? 

Coniferous 
Tree  Covered? 

Deciduous 
Tree  Covered? 

Test  Track 
Covered 

Visual  Data 

72 

1 200792:22:10:08 

Probably 

Probably 

Probably 

Probably 

No 

73 

1300192:03:30:04 

Probably 

Probably 

Probably 

Probably 

No 

82 

1600192:17:00:06 

Yes 

No 

No 

Yes 

Yes 

83 

1700792:07:10:10 

Probably 

Probably 

Probably 

Probably 

No 

86 

1800792:08:45:09 

Yes 

Yes 

Yes 

Yes 

Yes 

87 

1800792:21:50:03 

Probably 

Probably 

Probably 

Probably 

No 

88 

190  0792:03:25:09 

Probably 

Probably 

Probably 

Probably 

No 

89 

190  0792:09:00:08 

Yes 

No 

No 

Yes 

Yes 

92 

200  0792:12:00:02 

Yes 

Yes 

Yes 

Yes 

Yes 

93 

2100792:00:15:05 

Probably 

Probably 

Probably 

Probably 

No 

94 

2100792:02:10:01 

Probably 

Probably 

Probably 

Probably 

No 

95 

2100792:06:55:01 

Probably 

Probably 

Probably 

Probably 

No 

1  96 

2100792:11:15:01 

Yes 

No 

No 

No 

Yes  I 

97 

2100792:13:00:07 

Yes 

No 

No 

No 

Yes 

98 

2200792:01:10:07 

Probably 

Probably 

Probably 

Probably 

No 

Appendix  A 

Image  Data  Collection  Procedures 


The  infrared  (IR)  cameras  contain  no  built-in  blackbodies;  however, 
each  was  recently  calibrated  by  the  manufacturer.  Further,  these  DC- 
restored  scanning  radiometer  cameras  require  manual  setting  of  the  levels 
and  ranges.  Consequently,  a  procedure  was  employed  to  verify  the  accu¬ 
racy  of  the  radiometric  temperature  estimates  and  to  ensure  that  the 
manually  set  thresholds  of  all  images  were  within  dynamic  range.  The 
field  portion  of  this  procedure  consisted  of  the  following  two  steps: 

a.  Four  active  blackbodies  were  aligned  such  that  they  could  be  directly 
viewed  by  the  sensors  within  a  single  field  of  view.  The  blackbody 
on  the  extreme  left  was  set  to  ambient  temperature,  and  the  other 
three  blackbodies  (left  to  right)  were  set  to  the  ambient  temperature 
plus  10,  20,  and  30  °C,  respectively. 

b.  Before  and  after  an  imagery  data  collection  mission,  the  four  active 
blackbodies  were  imaged  by  the  thermal  cameras,  and  two  infrared 
images  were  taken:  far-IR  and  mid-IR.  Simultaneously,  the 
blackbody  temperatures  were  recorded. 

Upon  completion  of  imaging,  all  scene  images  were  automatically 
checked  to  identify  those  out  of  dynamic  range.  Images  with  more  than 
2  percent  of  the  brightness  values,  less  than  2  or  greater  than  253,  were 
rejected. 

The  accuracy  of  the  factory  calibration  was  examined  using  these  black¬ 
body  images  by  comparing  the  camera’s  radiometric  temperature  estimates 
with  the  temperatures  measured  from  the  blackbodies.  When  90  percent 
of  the  absolute  errors  were  under  3  °C,  the  factory  calibration  procedures 
were  used  for  a  given  excursion.  When  errors  exceeded  this  level,  a  cor¬ 
rective  procedure  was  employed.  It  consisted  of  a  linear  adjustment  to  fit 
the  camera’s  radiometric  temperature  estimate  to  the  temperature  of  the 
blackbodies.  The  formula  of  this  correction  is  as  follows: 

^BB  -  (^*  ^ 
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where: 


Tgg  =  physical  temperature  of  blackbody 

a  =  slope  estimated  by  least  squares  regression 
Tfj  =  camera’s  radiometric  estimate  of  blackbody  temperature 
b  =  intercept  estimated  by  least  squares  regression 

When  the  blackbody  temperature  estimates  could  be  corrected  to  meet  the 
above  acceptance  criteria,  the  corresponding  scene  images  were  used.  In 
the  end,  only  images  meeting  the  accuracy  criteria  were  used  for  analysis. 

These  cameras  were  mounted  in  a  remote-controlled  pan  and  tilt 
mount  atop  a  55-ft  boom  on  the  WES  boom  truck.  ^  The  imaging  proce¬ 
dure  was  first  to  rotate  the  boom  and  the  cameras  to  point  at  a  set  of  four 
active  blackbodies  provided  by  Eglin  Air  Force  Base  and  collect  image 
data  for  each  of  the  two  wave  bands.  Then,  the  boom  was  extended  to  its 
full  height,  and  thermal  cameras  were  rotated  to  aim  at  the  Site  E  area  to 
start  the  data  collection.  At  the  conclusion  of  the  sampling  period,  the 
boom  and  thermal  cameras  were  repositioned  to  collect  a  second  image  of 
the  blackbody.  These  blackbody  images  collected  at  the  beginning  and 
end  of  an  imaging  period  would  later  be  used  to  check  for  camera  accu¬ 
racy  and  make  any  necessary  correction. 


1  To  convert  feet  to  meters,  multiply  number  of  feet  by  0.3048. 
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